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A current empirical review of the treatment efficacy of Multisystemic 
Therapy (MST) for adolescent conduct problems (CP) was conducted. 
Conclusions based on this review suggest that MST can be a very 
powerful alternative to the usual legal and social service approaches 
(e.g. justice system, day treatment programs) used in the treatment of 
adolescent CP. Assessment of the overall quality of this body of research 
identified strengths in the provision of MST across various treatment 
locations, the various dependent measures used in the research, and the 
long-term follow-up periods. Limitations included the lack of specificity 
in the descriptions of treatment and comparison groups, the direct links 
between the majority of researchers and MST model developers, the 
lack of quality assurance measures, and the over-interpretation of 
findings from correlational studies. MST continues to expand 
nationally and internationally with relatively little empirical 
substantiation on the world stage. This review calls for further 
empirical scrutiny of MST efficacy with consideration of the outlined 
limitations. 

In recent prevalence studies conducted in the United States, the United 
Kingdom, and New Zealand, it is estimated that 15% of adolescents 
demonstrate severely disruptive social behavior (Curtis, Ronan, & 
Borduin, 2004). In clinical circles, such behaviors are referred to as 
Conduct Problems (CP) (Mash & Barkley, 1998). CP of this magnitude 
contribute to various difficulties at many levels of personal well- being 
(e.g. parental stress), family functioning (e.g. relationship problems), and 
community (e.g. vandalism) (Borduin, Mann, Cone, Henggeler, Pucci, 
Blaske, & Williams, 1995). Between 1999 and 2003, approximately 50,000 
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Canadian youths per year were found guilty of engaging in criminal 
code offences (i.e. crimes against the person, property crimes, serious 
traffic violations, & drug offences) (Statistics Canada, 2006). Traditional 
methods of addressing this behavior consist primarily of incarceration 
and probationary services. Alternative methods aim to develop social 
skills and enhance family functioning. In recent years, methods 
designed to enhance social and family skills have been applied and 
studied quite extensively. It is now generally accepted that Conduct 
Problems are very complex, pervasive, and highly resistant to 
intervention (van de Wiel, Matthys, Cohen-Kettenis, & Engeland, 2002). 
As such, there is great need for highly efficacious and comprehensive 
treatment interventions. Multisystemic Therapy (MST) (Henggeler & 
Borduin, 1990) may represent one such approach to addressing CP. 

Conduct Problems: Classification & Theoretical Conceptualization 

Mash and Barkley (1998) use the broad term CP to describe a disorder 
that is characterized by a variety of severely disruptive behaviors. CP 
has a high prevalence rate, with estimations of between 2% and 10% 
(Costello, 1990). Although there are several established frameworks for 
classifying CP symptoms (Mash & Barkley, 1998), the DSM-IV TR 
(American Psychiatric Association, 2000) is most commonly drawn upon 
by clinicians. The DSM-IV TR presents a classification scheme for two 
types of CP, Oppositional Defiant Disorder (ODD) and Conduct 
Disorder (CD). ODD is considered the milder of the two and is common 
in the early stages of CD. For a diagnosis of ODD, a minimum of four of 
the following symptoms must be present for at least six months: (1) 
losing temper, (2) arguing with adults, (3) refusal to comply with adult 
requests and rules, (4) deliberately annoying people, (5) failure to accept 
responsibility for misbehavior, (6) easily annoyed, (7) frequent anger and 
resentment, (8) spiteful and vindictive behavior. 

CD is characterized by repetitive violation of the basic rights of others for 
at least a year. Specific symptoms are subsumed by four categories: (1) 
Aggression to People and Animals, (2) Destruction of Property, (3) 
Deceitfulness or Theft, and (4) Serious Violations of Rules. Childhood or 
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Adolescent Onset Type is diagnosed according to whether or not one or 
more symptoms present prior to, or after, ten years of age. 

For bofh ODD and CD, fhese sympfoms musf be abnormally 
pronounced, impacfing on one or more areas of social, academic, or 
occupational functioning. Evidenfly, CP sympfoms are associafed wifh 
various facefs of a child's life. As such, fheorefical frameworks 
developed fo concepfualize fhe diverse sympfoms associafed wifh CP 
musf accounf for complex fransacfions befween children and fheir 
environmenf. 

Due fo ifs multi-level and mulfi-dimensional nafure, CP appears fo be 
mosf adequafely explained fhrough Bronfenbrenner's (1979) Social- 
Ecological Theory. This model presenfs a framework wifhin which 
antisocial behavior is hypofhesized fo derive from various etiological 
sources including school, work, peers, and communify. Since fhese are 
viewed as inferconnecfed, dynamic, and reciprocal, CP is assumed fo be 
mainfained by problematic fransacfions befween any combinafions of 
fhese sysfems. Therapeutic pracfices based on fhis model address fhe 
dynamic inferacfion befween various facefs of a child's life rafher fhan 
problems in isolation. 

Multisystemic Therapy 

Mulfisysfemic Therapy (MST) is derived from fhe Social-Ecological 
framework (Elenggeler & Borduin, 1990). If is an organized approach fo 
delivering empirically supporfed freafmenf fo youfh wifh CP by 
fargefing individual, family, school, peer, and communify confribufions 
fo fhe CP. 

There are nine principles fhaf govern fhe application of MST (Borduin, 
1994, p. 23). The nine principles are as follows: (1) fhe primary purpose 
of assessmenf is fo undersfand fhe "fif" befween fhe idenfified problems 
and fheir broader sysfemic confexf; (2) fherapeufic confacfs emphasize 
fhe positive, and use systemic strengths as levers for change; (3) 
infervenfions are designed fo promofe responsible behavior and 
decrease irresponsible behavior among family members; (4) 
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interventions are present-focused and action-oriented and they target 
specific and well-defined problems; (5) interventions target sequences of 
behavior within and between multiple systems that maintain the 
identified problems; (6) interventions are developmentally appropriate 
and fit the developmental needs of the youth; (7) interventions are 
designed to require daily or weekly effort by family members; (8) 
intervention effectiveness is evaluated continuously from multiple 
perspectives; and finally, (9) interventions are designed to promote 
treatment generalization and long-term maintenance of therapeutic 
change by empowering caregivers to address family members' needs 
across multiple systemic contexts. 

These guidelines set MST apart from eclectic therapy by serving as a 
frame of reference for decision making during the therapeutic process. 
By targeting numerous socio-contextual factors, MST can take many 
different turns and directions. The guidelines listed above assist 
therapists in providing treatment in a predictable and scientific fashion 
in order to maximize its efficacy. Furthermore, treatment is strictly 
monitored by quality assurance measures (e.g. assessment of therapist 
fidelity, use of empirically validated methods only, and continuous 
training and skill development) (Borduin, 1994). 

MST appears to be a comprehensive treatment for CP. Furthermore, it 
has well defined roots in Social Ecological Theory that provides a 
framework for describing the complex manner in which CP develop and 
impact various facets of life. Efficacy studies have made claims that MST 
is a viable alternative to the usual services offered to youths with CP. It 
would be unwise, however, to blindly accept these claims without prior 
scrutiny of the general quality of this body of research. 

Standards in Efficacy Research 

There are a number of research standards that are important for studies 
analyzing the efficacy of MST. First, specification of the treatment group 
and comparison group should be considered important. As noted, there 
is a vast array of symptoms that are associated with CP. Furthermore, 
CP is a disorder that is comorbid with ADFID, Anxiety, Depression, 
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Somatization Disorder (Loeber & Keenan, 1994), substance abuse, 
psychopathy (Frick, O'Brien, Wootton, & McBurnett, 1994), and 
underachievement in school (Hinshaw (1992). These problems can serve 
as confounding variables in the study of freafmenf, leaving fhe 
researcher uncerfain as fo fhe generalizabilify of fhe findings. As such, 
specificify of fhe freafmenf group is essenfial fo sound efficacy research 
(Wilhelm, Tolin, & Sfekefee, 2004). 

Furfhermore, careful considerafion should be employed during 
comparison group selecfion, as fhe decisions made during fhis process 
can easily dicfafe fhe final oufcome (Parker, Parker, Malhi, Wilhelm, & 
Mifchell, 2004). Sfudies fhaf use broad comparison groups (e.g. 
insfifufionalizafion) fail fo describe fhe specific fradifional approaches 
fhaf are piffed againsf MST. Wifhouf specific descripfions of fhe 
comparison groups, if is very difficulf fo defermine whefher MST would 
be effective in new seffings, where fhe fradifional infervenfions may be 
quife differenf. 

Treafmenf generalizabilify can also be enhanced fhrough fhe replication 
of effecfs in numerous locafions by many researchers Cunningham 
(2001). In fhis manner, researchers wifh a variefy of mofivafing inferesfs 
can fesf fhe freafmenf effecf. 

Sound efficacy sfudies should also use numerous measures of oufcome 
fo enhance fhe qualify of fhe research. This would be particularly 
imporfanf in MST efficacy research, as if fargefs mulfiple sysfems of life 
(e.g. communify, school, family, friends, healfh). Assessing fhe 
freafmenf effecf on many criferion variables (e.g. infemalizing, 
exfernalizing, recidivism) helps depicf fhe breadfh and depfh of fhe 
freafmenf effecf on many behavioral and emotional variables 
(Cunningham, 2001). 

Anofher imporfanf poinf fo demonsfrafe in efficacy sfudies is fhe 
endurance of freafmenf effecf over prolonged periods. This is achieved 
by measuring freafmenf oufcome over lengfhy follow-up periods. 
Cunningham (2001) suggesfed fhaf a follow-up period of af leasf one 
year should be considered in MST research. 


Developmental Disabilities Bulletin, 2006, Vol. 34, No. 1 & 2 



Review of Multisystemic Therapy 85 


Researchers engaged in demonstrating treatment efficacy must also be 
wary of problems associated with confirmation bias, as the 
preponderance of studies are conducted by researchers with direct links 
to the model developers. Confirmation bias occurs when people look for 
and interpret data in a manner that is consistent with preconceived 
beliefs (Evans, 1989; Nickerson, 1998). Conversely, data, which conflicts 
with these beliefs, tends to be ignored. This could easily lead to the 
reporting of false positive treatment effects. In order to reduce this 
possibility, MST efficacy studies should also be conducted by researchers 
who are not directly linked to the development of MST. 

Finally, sound MST efficacy studies should include measures designed 
to maximize adherence to MST procedures. The measures taken to 
ensure that therapists are adhering to the main tenets include 
monitoring, instrumental assessment of fidelity, supervision, and 
training. Studies have demonstrated that straying from the MST plan 
leads to diminished results (Henggeler et al., 1997; Schoenwald, 
Sheidow, & Letourneau, 2003). 

The Direction for the Current Review 

Testing MST efficacy has been the focus of a growing body of research. A 
recent empirical review by Henggeler and Lee (2003) includes 14 studies 
conducted from 1986 through 2002 (Henggeler et ak, 1986; Brunk, 
Henggeler, & Whelan, 1987; Borduin, Henggeler, Blaske, & Stein, 1990; 
Henggeler et al., 1991; Henggeler, Melton, & Smith, 1992; Henggeler et 
al., 1993; Borduin et al., 1995; Henggeler, et al., 1997; Henggeler, 
Rowland, et al., 1999; Schoenwald et al, 2000; Henggeler, Pickrel, & 
Brondino, 1999; Schoenwald et ak, 1996; Brown et ak, 1999, Henggeler et 
ak, 2002). 

The scope of the Henggeler and Lee (2003) review was quite broad, 
including studies examining MST effectiveness with violent juvenile 
offenders, youths in maltreating families, adolescent sexual offenders, 
youths with psychiatric emergencies, and substance abusers. This 
empirical review, in contrast, sets out to examine the efficacy of MST 
when applied to address adolescent CP, as defined by Mash & Barkley 
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(1998). Furthermore, it is more recent than the Henggeler and Lee 
review, it includes researchers who are not directly affiliated with MST 
model development and includes studies from oufside fhe Unifed Sfafes. 
Lasfly, fhis review summarizes, compares, confrasfs, and crifiques 
relevanf sfudies, whereas Henggeler and Lee provide more of a 
descripfive overview of published clinical frials. 

The value of conclusions drawn from fhis review is enhanced by fhe 
applicafion of research sfandards considered imporfanf in MST efficacy 
sfudies. Finally, suggesfions for improvemenf and fufure direcfions are 
based on fhe review ifself. 

This review of Mulfisysfemic Therapy ufilized five online dafabases fo 
idenfify perfinenf sfudies: Psychology and Behavioral Sciences 

Collecfion, PsycINFO, Science Direcf, ProQuesf Digifal Disserfafions, 
and fhe Canadian Nafional Crime Prevenfion Cenfre. Searches were 
direcfed using key lexical qualifiers, Mulfisysfemic and MST. The 
selecfion of sfudies for review was guided by fhe following inclusion 
criferia based on program legifimacy, research goals, and parficipanf 
demographics: (a) licensed MST programs served as freafmenf focus; (b) 
peer reviewed empirical sfudies (primary & secondary), disserfafions, or 
Canadian federal governmenf sfudies published befween 1995 and 2006; 
(c) dafa reflecfed freafmenf response oufcomes; (d) parficipanfs befween 
10 and 18 years of age; and (e) parficipanfs wifh histories of violenf, 
aggressive, and opposifional acfs, were included in fhe sample (i.e. no 
parficipanfs were exclusively subsfance abusers, sex offenders, or 
psychofics). 

Using fhese criferia, 12 sfudies were idenfified and evaluafed wifh 
respecf fo fheir considerafion of fhe following sfandards fhaf were 
idenfified earlier as imporfanf in MST efficacy research. These include 
fhe following: (a) specificify of freafmenf group; (b) specificify of 
comparison groups; (c) freafmenf locafions; (d) oufcome measures; (e) 
follow-up period; (f) affiliafion of researchers wifh MST model 
developers; (g) and adherence fo fhe MST model. 
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Borduin, Mann, Cone, Henggeler, Fucci, Blaske, and Williams (1995) 
conducted a Pre-test/Post-test controlled study in Missouri to assess MST 
versus Individual Therapy (IT) outcomes for 176 juvenile offenders, aged 
11 to 17, at high risk for committing further offences. Other participant 
demographics related to gender and race: 67.5% males, 30% African- 
American, 70% Caucasian, and 53% more than one parent. Instrumental 
results were gathered using multiple measures of individual adjustment, 
family relations, and peer relations. At post-treatment, this study 
reported the following significant effects favoring MST. Parental reports 
of personal psychiatric symptoms, child behavior, and family 
functioning (i.e. cohesion and adaptability) showed benefits from MST. 
In contrast IT treatment produced no benefit or actual deterioration on 
these variables. 

In an effort to determine the long-term effects of the treatment programs, 
recidivism rates were collected four years post-treatment on 94% of the 
original sample. This data, which was obtained through official court, 
police, and Department of Public Safety documents, revealed a 
recidivism rate of only 26% for the MST group compared to 71% for the 
IT group. Furthermore, a hierarchical multiple regression analysis 
revealed that recidivism rates for violent crimes were significantly less 
for MST youth compared to those in the IT condition. 

Schaffer (2001), a graduate student of Borduin used this sample, as well 
as, other archived (non-randomized) participants from the same area to 
study the moderators and mediators of MST outcomes at 10 years post- 
treatment. MST participants demonstrated 50% fewer arrests, 33% fewer 
days on probation as adults, and 60% fewer days in prison compared to 
participants who received IT or US. Participants from single parent 
families demonstrated less improvement on instrumental outcomes. 
Furthermore, improved family functioning was found to directly predict 
lower recidivism rates for the MST group. Finally, family engagement in 
MST mediated the relation between high family adversity and early 
dropout. 

Using a randomized Pre-test / Post-test design, ITenggeler, Melton, 
Brondino, Sherer, and ITanley (1996) set out to compare the efficacy of 
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MST with standard juvenile justice services (US) in treating 155 violent 
or chronic juvenile offenders in Soufh Carolina. The parficipanfs 
represenfed relafively diverse culfural and geographical demographics: 
a predominanfly Caucasian group (77.8%) from urban and rural 
locafions; and, a predominanfly African-American group (58.4%). The 
resulfs were collecfed fhrough mulfiple measures, including adolescenf 
emofional well being, behavior problems, self-reporfed criminal acfivify, 
arresf and incarcerafion hisfories, family relafions, parenfing skills, and 
peer relafions. MST adherence was also assessed fo defermine whefher 
or nof freafmenf fidelify served as a moderafor of observed oufcome. 
Upon follow-up 1.7 years posf-freafmenf, MST was found fo decrease 
incarcerafion levels by 47% compared wifh fhe US group. 

The resulfs of fhis sfudy did nof reflecf as favorably on MST as fhose in 
previous sfudies. This was affribufed fo fhe facf fhaf weekly supervision 
and monitoring of profocol adherence was nof incorporafed in fhe 
design of fhe sfudy. In furfher supporf of fhe adherence argumenf, 
Huey, Henggeler, Brondino, and Pickrel (2000) conducfed a sfudy fo 
assess fhe mechanisms fhrough which MST decreased delinquenf 
behavior in fwo samples of offenders. Sample one consisted of fhe 
parficipanfs from fhe Henggeler ef al. (1996) projecf, while sample fwo 
consisfed of parficipanfs presenfing psychiafric emergencies and, as 
such, is nof considered in fhe currenf review. In fhis sfudy, fherapisf 
adherence fo MST profocol was associated wifh improved family 
relafions (i.e. cohesion, funcfioning, & parenf moniforing), decreased 
delinquenf peer affiliafion, and decreased delinquenf behavior. 

In Onfario, Canada, a four-year efficacy sfudy of MST and usual services 
(US) was launched fo defermine if fhe resulfs found in fhe Unifed Sfafes 
could be replicated (Cunningham, 2001) This was a scienfifically 
rigorous design wifh sfricf randomizafion, a confrol group, and a 
relafively large sample of 409 adolescenfs, aged 10 fo lafe feens (i.e. ages 
varied slighfly according fo area need and funding requiremenfs). A 
number of variables were sfudied in relafion fo family funcfioning, 
youfh funcfioning, crime severify, convicfion, and cosf-eftecfiveness. The 
researchers were nof able fo recommend fhe implemenfafion of MST as 
an effecfive, cosf-saving freafmenf for fhe populafion of youfhful 
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offenders in Onfario as fhere were no significanf differences found 
befween MST and US on any of fhe variables assessed. 

Oakley (2001) conducfed a smaller scale sfudy, drawing upon some of 
fhe parficipanfs, 58 males and females, of fhe larger Onfario sfudy. The 
purpose was fo assess MST versus US effecfiveness on school oufcomes, 
an area fhaf was nof considered in fhe larger sfudy. The resulfs were 
mainly consisfenf wifh fhe large-scale findings. Parficipanfs in fhe MST 
group reporfed no significanf discrepancies regarding family-school link 
or affinify for school compared fo fhe US group. MST was, however, 
more effecfive fhan US in sfudenfs sfaying in school during fhe course of 
freafmenf, and in being enrolled in a community school post-treatment. 
Although further follow-up results are expected, at this time, the results 
present little evidence to support MST as a worthwhile undertaking in 
Ontario. 

Giles (2003) conducted a quasi-experimental comparing MST and Day 
Treatment applied to 60 adolescent males and females, aged 12 to 17, 
with diagnosis of Conduct Disorder. The Child and Adolescent 
Functional Assessment (CAFAS) was the outcome measure. The CAFAS 
(Flodges & Wong, 1996) gauges functioning in school and work, home, 
community, behavior towards others, moods and emotions, self-harm 
behavior, substance abuse, and thinking. 

Day Treatment (DT), in this study, was based on a cognitive-behavioral 
model with intense examination of behavioral patterns and associated 
thoughts and consequences. This method was administered for a period 
of 9 to 12 months and was applied three hours a day for five days a 
week. A crisis number for weekend support was also available. 
Assessment of outcome was determined at three months post-referral, as 
that was the termination time for MST. The results of this study failed to 
support any positive effect for either therapeutic approach. 
Furthermore, there were no discriminatory outcome effects of gender 
reported on any of the CAFAS domain scores. 

In a causative-comparative study of archival data by Smith-Toles (2003), 
pretest-posttest differences in outcome for MST, modified for a 
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residential setting, were examined. The comparison group received 
traditional methods of cognitive therapy, cognitive behavior therapy, 
and reality therapy. The sample consisted of 155 pre-adolescenf and 
adolescenf parficipanfs who exhibifed various delinquenf behaviors. 
Mosf of fhese behaviors were overf in nafure: fighting, cruelfy, explosive 
femper, arguing. Af fhree monfhs posf-referral fhe MST group showed 
reduced delinquency scores upon discharge. Furfhermore, family 
cohesion was rafed higher by parenfs of parficipanfs of fhe MST 
condifion. 

The Norway sfudy by Ogden and Halliday-Boykins (2004) is one of fhe 
firsf fo sfudy MST oufside of Norfh America wifh a non-English 
speaking sample. The purpose was fo replicafe fhe findings reporfed by 
fhe original developers of MST of producing more ouf of home 
placemenfs and long-ferm favorable oufcomes for seriously anfi-social 
youfhs fhan Regular Services (RS) freafmenfs of fosfer care, 
insfifufionalized placemenf, individualized counseling, parenf framing. 

Recidivism rafes were nof used in fhis sfudy because, in Norway, fhe 
judicial sysfem often direcfs youfh fo Child Welfare Services, and follows 
policies for adolescenf crime, which employ differenf contingencies fhan 
in fhe U.S. 

The sample included 12 fo 18 year old males and females who exhibifed 
severe aggression, violence, female promiscuify, and rule breaking. 
Youfh wifh primary issues fhaf were unrelafed fo fhe focus of fhe sfudy 
or posed a danger fo fherapisfs: subsfance abuse problems, suicidal 
ideology, autism, sex offenses, and dangerous homes - were excluded 
from fhe sfudy. Long-ferm resulfs (i.e. six monfhs posf infake) were 
obfained fhrough insfrumenfal assessmenf of various consfrucfs relafing 
fo family and youfh well being, as well as analysis of ouf of home 
placemenfs. The resulfs favoured MST in fhaf posf-freafmenf 
improvemenfs were evidenf in infernalizing behavior, exfemalizing 
behavior, social compefence, family cohesion, family adapfabilify, time 
af home, and freafmenf safisfacfion. 
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In a two-year post-intake follow up of this study Ogden and Hagen 
(2006) found that MST continued to be more effective than RS in 
reducing out of home placement and behavior problems. MST was 
found to be particularly effective with keeping males and older youths at 
home, compared to females and younger youths. 

In a recently published meta-analysis of seven primary and four 
secondary MST outcome studies, some very promising claims are 
reported (Curtis, Ronan & Borduin, 2004). This study set out to 
determine the overall impact of American-based MST programming on 
youths with histories of "social rule violations, acts against others, or both" 
(p. 412). Selection criteria included the following: (a) MST programs and 
adherence measures; (b) random assignment and at least one comparison 
group; (c) samples included youth with antisocial behavior and/or 
psychiatric symptoms; (d) pre/post outcome measures and/or follow up 
measures; (e) use of statistics that allowed meta-analysis. 

The results showed that MST youth and their families were functioning 
better than 70% of participants treated by usual or traditional methods. 
The effect sizes were greatest in MST efficacy studies using graduate 
student therapists rather than community-based therapists. Finally, MST 
was found to be more beneficial to family functioning than to individual 
adjustment and peer relations. However, the reported effect sizes were 
lower than in other efficacy studies. This suggests that more work may 
need to be done to improve the robustness of the MST effect. 

Timmons-Mitchell, Bender, Kishna, and Mitchell (2006) conducted the 
first randomized clinical trial of MST with juvenile offenders in the 
United States without the direct oversight of the developers of MST. In 
this study, MST was compared to Treatment as Usual (TAS), which 
included drug and alcohol counseling, anger management group 
assignment, and individual and family therapy. The sample consisted of 
93 youth who appeared before the county court of a Midwestern state. 
Those with a felony conviction or a suspended commitment to the 
Department of Youth Services incarcerating facility whose parents 
agreed to partake were included in the study. The participants were 15.1 


Developmental Disabilities Bulletin, 2006, Vol. 34, No. 1 & 2 



92 Jody Harpell & Jac Andrews 


years on average, 22% female, 15% African American, 77% European 
American and 4.2% were American Hispanic. 

Forfy-eighf were randomly assigned fo fhe MST freafmenf group. 
Dependenf measures included assessmenf of recidivism and youfh 
functioning. Youfh funcfioning was assessed using fhe CAE AS (Hodges 
& Wong, 1996). Recidivism was assessed jusf prior fo freafmenf, af 
ferminafion and af 18 monfhs posf-freafmenf for fhe MST group. For fhe 
TAS group recidivism was measured prior fo freafmenf, af six monfhs 
posf-freafmenf and 24 monfhs posf-freafmenf. The CAFAS was 
adminisfered prior fo freafmenf, af discharge and af six monfhs posf- 
freafmenf for fhe MST group. For fhe TAS group if was adminisfered 
prior fo freafmenf, af six monfhs posf-freafmenf and 12 monfhs posf- 
freafmenf. Qualify assurance procedures were utilized as recommended 
by MST developers. This sfudy demonsfrafed a significanf reduction in 
re-arresf, and improvemenf in four areas of youfh funcfioning on fhe 
CAFAS (i.e. home, school, communify, and moods & emotions). The 
effecf sizes, however, were lower fhan fhose reporfed in earlier efficacy 
sfudies. This is consisfenf wifh fhe lower effecf sizes found in fhe mefa- 
analysis of Curfis ef al., 2004. 


Discussion 


Specificity of Treatment Group 

Of fhe fwelve sfudies fhaf were reviewed, fhose focusing on a specific 
diagnosis were quite limited. Thus, although Giles (2003) drew a pool of 
youth diagnosed with CD, it is important to note that CD takes many 
forms and therefore, a general diagnosis of CD rates low on specificity. 
The fact that the diagnosis was determined through performance on the 
CAFAS, which includes eight domains including overt and covert 
manifestations of CD, underlines the non-specificity of the CD diagnosis. 

The rest of the studies accepted referrals based on chronic offender 
status, risk of re-offending, and general troubles associated with youth 
(Borduin et al., 1995; Cunningham, 2001; Giles, 2003; Henggeler et al., 
1996; Huey, 2000; Oakley, 2001; Ogden & Halliday-Boykins, 2004; Ogden 
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& Hagen, 2006; Schaffer, 2001; Smifh-Toles, 2003; Timmons-Mifchell ef 
al., 2006). None of fhese sfudies can effecfively demonsfrafe MST 
oufcomes for parficipanfs wifh highly specified social or psychological 
problems. 

This also holds frue for parficipanf race, SES, and gender, which were 
very heferogeneous across fhe sfudies. Sample demographics are 
described in mosf sfudies and if is clear fhaf conclusions regarding MST 
efficacy as a funcfion of human demographics are very weak (Ogden & 
Hagen, 2006). Fufure research musf address fhis concern by accounfing 
for specific diagnostic cafegories such as overf conducf disorders, as well 
as demographic variables. 

Specificity of Comparison Groups 

Providing a well-defined comparison group in sfudies is generally 
considered good pracfice (Cunnirmgham, 2001). This enhances fhe 
abilify fo predicf fhe efficacy of a freafmenf on fufure freafmenf groups. 
In MST research fhe comparison group generally refers fo a broad range 
of usual services available fo freaf and deal wifh juvenile delinquenfs. 
Therefore, a fhorough description of usual services is necessary so fhaf 
one can defermine whaf types of interventions are being compared. 

All of the studies included in this review described the roles of those 
administrating the method (e.g. therapist, probation officer) and the 
length of time involved. A number of the studies went as far as to 
describe the programming/procedures involved including Individual 
Therapy (Borduin et al., 1995; Schaffer, 2001; Timmons-Mifchell et al., 
2006), cognitive behavioral techniques in intense school based day 
treatment (Giles, 2003), cognitive-behavior and reality therapy (Smifh- 
Toles, 2003), and foster care, institutionalization, and other Child Welfare 
services (Ogden et al., 2004; Ogden & Hagen, 2006; Timmons-Mifchell et 
al., 2006). Several of the studies, however, fell short of adequately 
outlining the specific programming and/or procedures involved 
(Curmingham, 2001; Henggeler et al., 1996; Huey, 2000). For example, 
Curtis et. al.'s (2004) meta-analysis required only that at least one 
comparison group was included in each study. 
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In these examples, the descriptions were too vague with reference to 
specialized programming and there is no description of whaf usual 
services or social services enfail. This problem does nof appear fo be 
improving wifh fime, as fhe descripfions have remained fragmenfary 
since fhe early phases of fhis research. To simply use a descripfor such 
as usual services or traditional methods is obviously insufficienf. 
Accordingly, sfudies musf go an exfra sfep and label fhe specific 
freafmenfs (e.g. day freafmenf, insfifufionalizafion). 

The problem is fhaf social services, in general, are markedly discrepanf 
from sfafe fo sfafe and province fo province. Therefore, one musf nof 
assume fhaf fhe reporfed effecfs would be found in ofher areas, or, fhaf 
implemenfing a MST program would even be a worfhwhile endeavor. 
In view of fhe vigorous efforf fo mainfain MST principles during 
freafmenf, if is highly probable fhaf oufcome variafion is due fo 
comparison group differences such as highly inadequafe versus highly 
adequafe probafionary sysfems. 

Conversely, a failure fo find effecf differences befween freafmenf groups 
may be due fo fhe inclusion of a comparison freafmenf fhaf closely 
resembles MST. In many ways, MST is nofhing more fhan a 
sysfemafized formal for ensuring fhaf responsible, fherapeufic pracfice 
based on empirically subsfanfiafed research fargefs mulfiple facefs of an 
adolescenf's life. Many fypical services likely have fherapisfs who 
adhere fo very similar professional sfandards. For fhese reasons MST 
efficacy research has fo make a better efforf fo define comparison 
freafmenfs so fhaf prospective implemenfers of fhe fechnique will be able 
fo gage ifs viabilify and generalizabilify more effectively. 

Treatment Locations 

In order fo gauge fhe level of confidence fhaf can be placed in MST effecf 
generalizabilify, adminisfrafion of fhe freafmenfs in more fhan one 
geographical location was deemed fo be an imporfanf feafure of each 
sfudy's design. Of fhe 12 sfudies reviewed (nof including fhe mefa- 
analysis), five drew upon a pool of parficipanfs from only one location 
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(Borduin, 1995; Giles, 2003; Oakley, 2001; Schaffer, 2001; Timmons- 
Mifchell, 2006). Two sfudies used fwo sifes (Henggeler ef al., 1996), 
while anofher used fhree (Smifh-Toles, 2003). Huey ef aTs (2000) sfudy 
drew upon several pools, buf only one was considered perfinenf fo fhe 
currenf review (i.e. adolescenfs exhibifing CP). The Canadian 
(Cunningham, 2001) and Norwegian (Ogden ef al., 2004; Ogden & 
Hagen, 2006) sfudies measured MST efficacy in four regions. Applying 
freafmenf in mulfiple locafions decreases fhe chance of affaining dafa 
from an afypical sample of adolescenf delinquenfs. As such, 
generalizabilify of effecf is less quesfionable compared fo single locafion 
sfudies. Currenf research frends appear fo demonsfrafe a realizafion of 
fhis problem, alfhough fhe recenf Timmons-Mifchell (2006) sfudy 
represenfs an excepfion. In fhis regard, MST research is enhancing fhe 
credibilify of ifs findings and fhis should confinue in fufure sfudies. 

Outcome Measures 

The sfudies in fhis review sef ouf fo analyze MST oufcomes fhrough 
measures of family funcfioning, adolescenf behavior, and recidivism. 
Incorporafing mulfiple measures of oufcome is considered imporfanf in 
fhis review fo ensure fhaf fhe research was driven by a variety of 
research questions. Of the researchers involved, there would be less 
chance of directional bias resulting from the interests of one stakeholder 
or one specific purpose. Most of the studies examined incorporate 
multiple measures of outcome representing all three domains listed 
above (Borduin ef al., 1995; Curmingham, 2001; Henggeler, 1996; Huey, 
2000; Schaffer, 2001; Timmons-Mifchell, 2006). Three of the studies 
(Ogden ef al., 2004; Ogden & Hagen, 2006; Smifh-Toles; 2003) utilize 
multiple measures of adolescent behavior and family functioning, but do 
not report on recidivism rates. In Norway (Ogden ef al., 2004; Ogden & 
Hagen, 2006), recidivism rates do not apply to the adolescent 
demographic, while the Smifh-Toles (2003) study was directed toward 
studying MST effectiveness in residential treatment programs where 
recidivism was not a factor. The purpose of Oakley's (2001) study was to 
augment the results of the grander Ontario study (Curmingham, 2001) 
with measures of school-related outcomes pertaining to family and 
adolescent behavior. Although the measures were limited, they 
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augmented the results of the larger study quite well. Only one study 
used a single measure of oufcome, fhe CAP AS (Giles, 2003). Alfhough 
fhe CAP AS includes several domains (i.e. home, school, communify, 
behavior toward self and ofhers, moods/emofions, self-harm, fhinking, & 
subsfance abuse) and good psychomefric properties (e.g. fesf-refesf & 
infer-rafer reliabilify .6 to .7 and good concurrenf & predictive validify) 
(Piodges & Wong, 1997), if is only one insfrumenf and may or may nof 
sufficienfly describe MST efficacy. 

In fhis review, fhe vasf majorify of sfudies drew upon mulfiple indicators 
of oufcome perfaining fo youfh behavior, family functioning, and, where 
applicable, recidivism and convicfion. As such, one can form well- 
grounded conclusions regarding fhe breadfh and depfh of fhe 
fherapeufic effecf (i.e. an effecf does occur). The Norwegian sfudies 
(Ogden ef al., 2004; Ogden & ITagen, 2006) included mulfiple measures 
of oufcome, buf many of fhe insfrumenfs were nof sfandardized for fhe 
Norwegian population. As MST research extends info various counfries, 
fhis problem will have fo be overcome fhrough re-sfandardizafion of fhe 
oufcome measures. Alfhough comparison fo fhe confrol group can sfill 
be conducfed, one cannof be cerfain fhaf fhe fargef consfrucfs are being 
measured. Pufure research conducfed in non-English speaking counfries 
should consider addressing fhis problem prior fo invesfing fhousands of 
dollars foward conducting MST frials. 

Follow-up Period 

Plaving sufficienf follow-up dafa is essenfial fo fesfing fhe sfaying power 
of any freafmenf. Purfhermore, sysfem differences can confribufe fo very 
differenf findings over time. Por example, Cunningham (2001) reporfed 
major discrepancies befween convicfion rates af six monfhs (71% nof 
convicfed) compared fo fhose af 36 monfhs (79% convicfed). This was 
credifed, in parf, fo lengfh of fime fo fry alleged criminals in fhe 
Canadian judicial sysfem. Cunningham (2001) sfrongly suggesfs fhaf 
long-term efficacy measures be faken af a minimum of one-year posf 
freafmenf. Of fhe sfudies reviewed, fhe majorify included reporfs of 
long-term effecfs of af leasf one year. This is likely sufficienf, as fhe ofher 
sfudies focus on recidivism rafher fhan convicfion. Borduin ef al. (1995) 
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reported effects of MST at four years post-treatment and again at 10 
years (Schaffer, 2001). Cunningham's (2001) study reports interim 
results at four years with the intention of presenting further follow-up 
this year. Henggeler (1996), augmented by Huey (2000), presented a 1.7- 
year follow-up of MST effects. Three studies fall short of meeting the 
one-year follow-up expectation proposed by Curmingham (2001) (Giles, 
2003; Oakley, 2001; Smith-Toles, 2003). Curtis, et. al.'s (2004) meta- 
analysis includes studies with follow-up data, but no specific follow-up 
criteria. Research in this area should continue investigating the long- 
term impact of MST so better assessments of its therapeutic effect, cost 
saving potential, and social impact can be formulated. 

Affiliation of Researcher with MST Model Developers 

Since the original developers, their close colleagues and students, 
generated the preponderance of literature related to MST determining 
the researchers affiliation is important. Narrowing this review to focus 
on outcomes for adolescents with CP helped diversify the authorship 
base because so many studies conducted by MST developers are 
dedicated to examining the effect of MST on substance abusers (Randall 
& Cunningham, 2003), on youths with suicidal ideology and other 
psychiatric emergencies (Huey, Henggeler, Rowland, & Halliday- 
Boykins, 2004) and on participants with sexual behavior problems 
(Letoumeau, Schoenwald, & Sheidow, 2004). 

In the current review, five of the twelve studies have authors with direct 
links to the original development of MST (Borduin et ak, 1995; Curtis et. 
al., 2004; Henggeler et. al., 1996; Huey et. al., 2000; & Schaffer, 2001). 
With the exception of the meta-analysis, this accounts for almost 35% of 
the total participant population. Collegial connections to the developers 
are also apparent in the Canadian and Norwegian studies. This is likely 
difficult to avoid, as training must be provided and MST developers 
must grant licensure before programs are considered legitimate. Only 
one American based study (Timmons-Mitchell et al., 2006) claims to have 
no ties to the MST model developers. While this trend is reflective of 
responsible practice on the part of MST developers, it would be better to 
have independent researchers studying efficacy. In recent years, MST 
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research has been spreading throughout North America and overseas. 
To date, the results of these studies are quite discrepant and 
unconvincing. While the Norwegian studies show promise for MST 
(Ogden ef al., 2004; Ogden & Hagen, 2006), fhe Canadian sfudy's inferim 
conclusion was fo nof endorse fhe use of MST in Canada (Cunningham, 
2001). More infernafional researchers, particularly fhose wifh no direcf 
ties fo fhe MST developers, should fake on fhe challenge of measuring 
fhis program's effecfiveness. 

Program Adherence 

There is growing advocacy for fhe inclusion of procedures fhaf maximize 
MST program fidelify (Henggeler ef al., 1997; Schoenwald, Sheidow, & 
Lefoumeau, 2003). And recenf sfudies generally include fhe use of sfricf 
supervision, ongoing framing, and measures of adherence fo monifor for 
fidelify. Of fhe sfudies examined, four had no mechanism in place fo 
ensure program adherence (Borduin ef al., 1995; Giles, 2003; Schaffer, 
2001; Smifh-Toles, 2003). Wifh fhe exception of fhe mefa-analysis (Curtis 
ef. al., 2004), fhese sfudies accounfed for almosf 40% of fhe fofal. None of 
fhese projecfs, save Borduin ef al.'s (1995), had confrol over including 
such measures in fheir design because fhey used archival dafa. Borduin 
ef al.'s sfudy was conducfed early in fhe course of MST research and 
fherefore did nof include such measures. Alfhough fhe Henggeler ef al.'s 
(1996) and Huey ef al. (2000) sfudy incorporafed an MST adherence 
measure, fhese did nof include weekly monitoring. The Norwegian and 
Canadian sfudies included vigorous indicafors of fidelify consisting of 
regular framing, weekly moniforing, and adherence measures. Curtis ef. 
al.'s (2004) mefa-analysis required measures of program adherence as 
parf of fhe sfudy selection criteria. 

Clearly, program fidelify is faken very seriously in MST research 
(Schoenwald, Sheidow, & Lefoumeau, 2003), buf recenf sfudy reporfs 
low adherence. Affer all of fhe precautions and focused efforfs fo keep ifs 
fherapisfs on frack, fhere are still fhose who veer from fhe plan. This may 
accounf in parf for fhe less robusf oufcomes. 
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Researchers may be overlooking an important consideration regarding 
fidelity. It is possible that therapists who do not adhere closely to the 
principles of MST are finding that their participants are not responding 
favorably to the treatment, and a new course of action is implemented. If 
that is the case, therapists scoring lowest in fidelity may be those treating 
the most resistant of CPs. This may account for the unfavorable MST 
outcomes within this group. 

Future studies should take a hard look at participants whose therapists 
get sidetracked from the typical MST approach to examine possible 
characteristic behavioral patterns or clusters, which could contribute to 
their being sidetracked. In other words, rather than blaming therapists 
for MST shortcomings, refine the treatment by analyzing youth and 
therapist characteristics in order to better understand where MST does 
and does not apply. 

Another problem associated with enforced fidelity relates to stagnation 
of the therapy. MST research has been driven by one goal: to validate its 
effectiveness. There appears to be very little effort invested in making 
changes to the overall procedures. In other words, rather than focusing 
on development of the treatment, the focus is on keeping it the same. 
Future research should strive toward making subtle therapeutic changes 
based on the identification of effect weaknesses. 

Limitations of the Current Review 

The current review of MST research presents its own set of limitations. 
For one, the studies available relating specifically to CP in peer reviewed 
journals are rare. As a result the pool had to be extended to include 
Ph.D. dissertations and a federally funded government study. Although 
these studies were highly pertinent to the topic at hand, a better scenario 
would be to include studies that undergo a common method of scrutiny. 

Another problem with this review relates to determining MST effects on 
a specific behavioral demographic. As noted, CP encompasses a variety 
of behavioral possibilities. Although there were clear exclusionary 
criteria in each of the studies outlined, the participants to be studied 
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remained diverse in many ways. Inclusion criteria were often based on 
broad behavioral problems associated with violence and criminal 
behavior. As such, the target group definition, CP, remains less succinct 
than the reviewers would like. As MST research becomes more plentiful 
and more specialized, fhese limifafions will likely pose less of a challenge 
fo fufure reviewers. 


Conclusion 

This review sef ouf fo analyze MST effecfiveness in addressing CP 
among adolescenfs. If would appear fhaf MST could be a very powerful 
alfernafive fo usual legal and social services (e.g. jusfice sysfem, day 
freafmenf programs). The research is adequafe in ferms of inclusion of 
various freafmenf locafions. This helps ensure fhaf observed effecfs are 
nof gained from an afypical sample, fhus enhancing confidence in 
freafmenf generalizafion. Furfhermore, fhe sfudies do well in including 
various dependenf measures of freafmenf effecf. As such, fhere is less 
chance of direcfional bias on fhe parf of sfakeholders in fhe developmenf 
of MST. For fhe mosf parf, follow-up periods have been long enough fo 
assure long-ferm durafion of fhe MST effecf. 

Despife fhese sfrengfhs, MST and research on if musf improve in several 
ways. For one, fhe circumsfances, which confribufe fo more and less 
robusf MST effecfs, are nof clear. This appears fo be due fo a lack of 
specificity in regard to description of freafmenf groups and comparison 
groups, as research is weak in fhis area. As such, if is very difficulf fo 
know where MST should and should nof be applied. 

Furfhermore, individuals who have direcf links fo MST model 
developmenf have conducfed fhe preponderance of research. To dafe, 
fhe resulfs of more independenf researchers do nof sufficienfly replicafe 
fhe earlier resulfs. Before MST is claimed fo be a viable alfernafive fo 
usual services, more independenf researchers musf conducf efficacy 
sfudies. 

Finally, MST program adherence by clinicians has been posifively 
associafed wifh freafmenf effecf. Unforhmafely, researchers have failed 
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to recognize that behavioral resistance to MST may account for infidelity 
on the part of researchers. As such, rigorous checks and balances have 
been incorporated into the MST model, which maximize adherence, 
possibly forcing therapists to apply strategies that are simply ineffective. 
Efforts to enhance the authenticity and consistency of the treatment may 
actually serve to stunt the evolution of MST. Despite these concerns, 
MST continues to expand nationally and internationally with insufficient 
empirical substantiation on the world stage. This review calls for further 
empirical scrutiny of MST efficacy in line with the outlined points. 
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